Tradeoff Analysis of Different Markov Blanket Local Learning Approaches
نویسندگان
چکیده
Discovering the Markov blanket of a given variable can be viewed as a solution for optimal feature subset selection. Since 1996, several algorithms have been proposed to do local search of the Markov blanket, and they are proved to be much more efficient than the traditional approach where the whole Bayesian Network has to be learned first. In this paper, we compare those known published algorithms, including KS, GS, IAMB and its variants, PCMB, and one newly proposed called BFMB. We analyze the theoretical basis and practical values of each algorithm with the aim that it will help applicants to determine which ones to take in their specific scenarios.
منابع مشابه
Learning Bayesian Network Structure using Markov Blanket in K2 Algorithm
A Bayesian network is a graphical model that represents a set of random variables and their causal relationship via a Directed Acyclic Graph (DAG). There are basically two methods used for learning Bayesian network: parameter-learning and structure-learning. One of the most effective structure-learning methods is K2 algorithm. Because the performance of the K2 algorithm depends on node...
متن کاملMarkov Blanket Discovery in Positive-Unlabelled and Semi-supervised Data
The importance of Markov blanket discovery algorithms is twofold: as the main building block in constraint-based structure learning of Bayesian network algorithms and as a technique to derive the optimal set of features in filter feature selection approaches. Equally, learning from partially labelled data is a crucial and demanding area of machine learning, and extending techniques from fully t...
متن کاملLocal Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part II: Analysis and Extensions
In part I of this work we introduced and evaluated the Generalized Local Learning (GLL) framework for producing local causal and Markov blanket induction algorithms. In the present second part we analyze the behavior of GLL algorithms and provide extensions to the core methods. Specifically, we investigate the empirical convergence of GLL to the true local neighborhood as a function of sample s...
متن کاملImproving Structure MCMC for Bayesian Networks through Markov Blanket Resampling
Algorithms for inferring the structure of Bayesian networks from data have become an increasingly popular method for uncovering the direct and indirect influences among variables in complex systems. A Bayesian approach to structure learning uses posterior probabilities to quantify the strength with which the data and prior knowledge jointly support each possible graph feature. Existing Markov C...
متن کاملAlgorithms for Large Scale Markov Blanket Discovery
This paper presents a number of new algorithms for discovering the Markov Blanket of a target variable T from training data. The Markov Blanket can be used for variable selection for classification, for causal discovery, and for Bayesian Network learning. We introduce a low-order polynomial algorithm and several variants that soundly induce the Markov Blanket under certain broad conditions in d...
متن کامل